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This research has as its basic premise the belief that physical and mental 
skills are highly similar* enough so in fact that computation paradi 9 ns 
such as the ones used in Artificial Intelligence research about predomi¬ 
nantly mental skills can be usefully extended to include physical skills. 

This thesis is pursued experimentally by the categorization of “juggling 
bugs 1 ' Vis detailed video Observations, A descriptive language for juggling 
movements is developed and a taxonomy of bugs is presented. The remainder 
of the paper is concerned with an empirical determination of the character¬ 
istics of an ultimate theory of juggling movements. The data presented is 
relevant to the computational issues of control structure, naming, addressing 
and s u bproceduHza ti on♦ 
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jjnt-roGluctfqn 


This paper analyzes the physical skill of juggim, frm the 

«1e« of the procedural paradigm of the newTy developing field of 
Intel Tig&nce. 


DOTPlt of 
Artificial 


The study of the mechanise af physical or motor 
activity has been a classical there of a hide 
variety of scientific disciplines including 
psychology and neurophysiology. The approaches 
employed in the investigation of sensorimotor 
phenomena have ranged from the very local i. e . 

Single neuron studies to studies of global still 
acquisition strategies. Important Issues this 
research has helped to clarify include the nature 
of reflex and the precise extent to which sensory 
Input controls motor activity. 

Despite vast amounts of sensorimotor data hoover t we are still 

larse'J in the dark on important general Issues, such as the difference 

between "physical" a„d "intellectual” activity as well as on specific 

questions such as how new physical skills are constructed from existing 

ones. The present research attempts to sharpen these issues by means of 

extremely detailed empirical observations and by the development • 

of theoretical models. A major conclusion of the paper is that physical 

skills are considerably more "intellectual" in nature than hithertofore 
believed 



The Procedural Farad fair 


This section U a brief aside about the Artificial Intelligence 
Philosophy which underlies the expert [rental approach. A more exten¬ 
sive discussion can be found in Minsky, Papert and Winoarad ft-3). 

The most important aspect of any theory or paradigm is the degree to 
which it explains 4 or has the potential to explain, observed phenomena. 

Of course different paradigms use different criteria for testing to see 
whether or not a given theory "explains 11 a particular set of observations. 

The procedural paradigm of Artificial Intelligence 
(A,I.) holds that knowledge Is stored Internally In 
a for^n which can be modeled accurately by means of 
computer procedures , Hence the relevant questions 
for a given theory have to do with the control 
structure associated with the procedures, the 
mechanisms by which that control structure retrieves 
and activates procedures, the bugs (i.e. mistakes} 
encountered during activations and the process by 
which those mistakes are debugged (corrected). 


Since recent work in A.I, provides a wide variety of control and acti¬ 
vation strategies from which to choose, the most crucial questions for judging 
the merits of a specific theory, for example a theory of juggling, are 
what kinds of bugs occur when a person learns to juggle and how are these 
bugs fixec. In particular »i f it Is possible to exhibit a taxonomy of 








"juggling bugs" and to describe precisely hpw these bugs are removed then 
you have given a Complete theory of juggling* i.e* 

taxonomy + Fixes = theory 

Section 7 gives such a taxonomy for 3 ball cascade juggling, obtained 
by extensive analysis of video protocols of adult subjects learning to 
juggle. As we shall see later the precise description of a process by which 
observed bugs can bo corrected Is considerably more difficult to obtain. 

Before proceeding further however the details of the expert rental setup 
are given.. 

The Experimental Setup 

This sections explains two unusual aspects of the experimental sJtua- 
t'on. The first aspect is the extensive use of instruction, i„e. a teacher, 
during the learning period. The second is the use of video equipment to 
record the experimental trials. 

The use of a teacher was very nearly mandatory given the decision to 
study the skill of juggling, Juggling was felt to be an excellent choice 
for detailed analysis since It aupears to be a very complicated skill but 
In fact requires. Tittle crone than the ability to toss and catch an object 
and the ability to visually track moving objects. These prerequisite 
skills are usually highly developed In normal adults. Hence the learning 
required for juggling focuses on the recombination of existing well- 
developed movements rather than the formation of entirely new ones. 
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Unfortunately, Informal experiments show that very few people learn even 
the Dost simple kinds of Juggling without the benefit of Instruction. 
Although it is perhaps reasonable to conjecture that most people caul if 
eventually learn to juggle on their our given Sufficient motivation , the 
amount of time required would most likely rule out short temr learning 
experiments as well as unduly complicate the data collection problem. 

These problems were avoided by the active us# of a teacher during the 
learning trials. 

The use of the video equipment to record data was likewise essentially 
forced. It is virtually impossible to accurately record experimental trials 
which involve the study of complicated human movement without some sort of 
visual recording device such as a film or video technology* Video tape Is 

more desirable than film since it requires no development time and can he 
erased and reused. 

CASCADE vs. SHG'iJEnS: i-JHICI! TO&EL DO YOU HAVE? 

The following paragraphs explain in detail the precise nature of the 

experimental task. In addition* the first important empirical observation 
fs. presented. 

The subjects were randomly selected undergraduate, graduate and faculty 
members of the M*I.T. community ranging in age from 18 to 5D. Twenty 
subjects were involved of which approximately half were video taood. The 
rest of the experiments were recorded by a contination of thfrd party 
observers and/or audio recordings. Ho significant difference was found In 


i 







the two groups. 


The experiment proceeded as follows; after a brief Juggling demon¬ 
stration* the Subject was asked to demonstrate, in slow motion, his or 
her model of juggling. 


Juggling can be defined as keeping more objects 
in the air than you have hands. For example keeping 
2 objects in the air with one hand Tike this 


Figure 1 



is juggling since only one hand Is involved hut Z 
people tossing 4 balls back and forth simultaneously 
are not juggTtng since a total of 4 hands are being 
used, 

Cascade juggling* perhaps the most common and certainly the most 
simple form of 3-ball Juggling is illustrated by the following sequence 
of Sketches: 










Figure £ 


CASCADE JUGGLING 
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It is interesting to note that almost aTI of the subjects tested did 
not describe the "cascade' model of juggling. Rather* they almost invariably 
described a form of what is cornro.nly known as "showers" juggling in which 

one hand does the same throw over and over while the other hand does all of 
the catching. 


SWOWtKS vSt CASCADE 



rhe difference in the two techniques can be said (at the risk of over¬ 
simplification) to lie In the fact that during SHOWERS a given hand either 
tosses or catches,but never b&th, while in CASCADE a given hand alternately 
tosses and catches. In SHOWERS the catching hand either physically passes 
each ball to the tossing hand or tosses it horizontally to the tossing 

hand. Whereas in CASCADE the tosses are all vertical no matter which hand 
they come from.* 

This observation. Interesting in its own right* is important experi¬ 
mentally because the initial'demonstration each subject was given was a 


*for an excellent description and further details, see CARLO (4) 















demonstration of CASCADE juggling which is considerably easier to learn 
than showers. The subjects persisted in theSH0WER5 model even after the 
CASCADE demonstration and!, left to their own devices, would have undoubtedly 
failed even more miserably than subjects left on their own with the 
CASCADE task. The Important observation her is that the formation of 
juggling models* be it CASCADE dr SHOWERS or whatever, is an entirely 
mental pr ocess ^ It has nothing whatsoever to do with muscles, neural 
pathways in the usual sense or sensory feedback* Hence the first step 
in the experiment provides us with our first clue as to the relationship 
between "physical" and "mental" acts* You cannot perform a physical 
act (at least a skilled one) until you have an accurate mental model or 
representation of that act! 

Performance Data 

This section redefines the experimental task and gives performance 
data for the "typical juggler" in terms of that definition* 

After correcting "model errors" the subjects were led through a 
series of exercises in which they learned to control first one toss* then 
two, then three and so on* CASCADE juggling has the nice feature that 
both a SINGLE TOSS* 

figure $ SINGLE TOSS 













and a DOUBLE TOSS, 
Figure 5 _ 


double TOSS 



are very easy to do, Almost everyone doe* them reasonably well on the 
first try. The TRIPLE TOSS is considerably mors difficult and hence de¬ 
serves further analysis. 

Tbe essential feature of the TRIPLE-TOSS Is that it requires, after 
art initial TOSS with the right hand*, a rapid TOSS-CATCH sequence with 
first the left and then the right h 4 nd followed by a concluding left- 
hand CATCH. The TRTPL(:-T0$S Is illustrated in figure 6. 


Virtually atT juggling algorithms are handwise reversable. 










figure 6 
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TOSS by 
rioht rand 


TOSS-CATCH 
by left hand 


TOSS-CATCH 
by right hand 


Concluding CATCH 
by left hand* 


The real difficulty lies, in the rapid TOSS-CATCH sequences* for good 
reason as we shall see later, For now we shall be content to observe that 
if w$ relabel these sequences* cal lino them E*CHANGES,then the description 


















of CASCADE juggling reduces tp; 


TOSS 

exchange 

EXCHANGE 

exchange 


to initialize 


an indefinite series 
of exchanges 


EXCHANGE 

EXCHANGE 

CaTC - H and a concluding catch 

Given this description, it Is easy to 5S4 ^ the ability to do 3 
tosses is an important step in tire learning experience. At that point 
the subject performs the hardest step, the EXCHANGE, once with each 
hand: 

TOSS 

EXCHANGE (left hand) 

EXCHANGE (right hand} 

CATCH 

The rest of the learning process consists of fine-tuning the basic 
EXCHANGE sequence. The experimental data shows that the average person 
takes approximately 7 minutes to succesfully complete 3 tosses. Figure 
7 gives performance data for a hypothetical average juggler in terms of 

nombnr of tosses amoved after a given nunber of minotes practice. 
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EIKS [niirute3j 


]' Jesforaanoe of the average juggler. This graph is 
intended to indicate the performance of a hypothetical "average 
during the first "ID minutes of ths experimental 
training period, ¥roca this perspective it makes sense to say, 
for example, that the average juggler can do tosses after 
v minutes. It should be noted that several of the sub lee la 
quit before the 30 minutes elapsed. This was due to fa) frus¬ 
tration (4 people) or £b) the achievement of 10 or so tosses 
{5 people), Nevertheless, it is felt that the graph is repre¬ 
sentative or average performance. 








Common Bugs and Their fixes 


Most people exhibit a fairly standard sequence of bugs. The following 
section discusses In detail two of the most ©owner, bugs and their 
recDJimended fixes. 


Tmrro bugs 

If we suspend now the narration of the experiment and return for a 
moment to the procedural paradigm, we see that the EXCHANGE task is Impor¬ 
tant for another set of reasons. It Is here, at the EXCHANGE sequence, 
that the first serious bugs begin to show up in the learning process. 

These bugs usually relate in one way or another to either subtle or gross 
timing errors. Thus- it is fair to say, at the risk of precision, that 
the most common kinds of -bugs in learning to Juggle are timing 


bugs. 

The most frequently occurring timing bug usually manifests Itself as 


a variation on the following theme. 


FORWARD SUG 


Figure 3 



Normal right hand 
TOSS followed by 
FORWARD left hand 
TOSS 















The first ball is tossed correctly. It has the proper height fslightly 
higher than the forehead) and width {slightly less than shoulder wide}. The 
second ball* however, is tossed almost directly forward with little or no 
vertical velocity. This hug appears to be due to the comon tendency to 
swing the forearm from the elbow when tossing an object. The resulting 
trajectory is then critically dependent on the precise Instant the 
Obj&ct is released by the fingers. An early release, perhaps caused by 
concern about the incoming ball, causes the second hall to go forward 


rather than up* A late release causes the ball to be thrown back towards 
the juggler. 



LATE RELEASE 



Figure 9 


Of course the correct solution is either to release the outgoing ball 
at approximately the vertical tangent point of the swing or to move the arm 
in a vertical direction only 5P that it doesn't matter when the ball is 
released. >he £ fixes" are accomplished respectively by having the subject 

juggle while standing near (within arms reach) and facing a wall or by 




teaching the subject a special largely vertical throwing motion fcnown as 
popping," 

POPPING Figure 10 


The FORWARD TOSS bug sometimes occurs on the second toss but usually 
appears on the third toss or at other points of difficulty, 

THE EARLY LATE BUG 

It Should be noted at this point that the FORWARD bug is relatively 
ease to fix in comparison to another member of the timing class, the 
EARLY-LATE bug^ The EARLY-LATE bug occurs as the name suggests, when one 
or marc of the TOSSES is early or late with respect to the evenly spaced 
rhythm of smooth juggling. Unevenly spaced TOSSES necessitate especially 
rapid (or slow) EXCHANGES one step later which ere usually beyond the reac 
of beginning jugglers. 



THE WALL 


















EARLY-LATE BUG 


Figure 



In this example an early second toss has necessitated i rushed right 
hand EXCHANGE at the Same time a left hand CATCH fs required. 

The fixes for the EARLY-LATE bug all involve helping the 
subject to identify a good timing sequence for TQSSE5. One way of doing 
this is a game called OROPCATCH. In DFOPtATtH the subject is asked to 
execute a modified double toss in which the first ball Is tossed as usual 
but the second ball is dropped or thrown onto the ground at the last 
possible Instan t before the incoming baTT arrives. Tins of course focuses 
attention on the timing involved In holding on as Tong as possible. With- 
this newly discovered ’'timing point" fresh in mind [which is very similar 
to the correct time for EXCHANGE Initiation) it is frequently possible to 
achieve a good TOSS rhythm on the next trial. Perhaps a better method fs 
to prevent the Occurrence of the EARLY-LATE bug as much as possible by 
Strongly emphasizing a proper rhythm during the demonstrations. 












A Taxoriorny of Juggling Bugs 


This section presents the main body of -empirical results produced by 
the experiment. nancly a taxonomy o-f juggling hugs and their associated 
fixes- 

The preceeding timing bugs, REWARD-TOSS and EARLY-LATE as well as the 
URONG-ttENTAL-MOaEj. hug mentioned earlier have been analyzed in detail 
(along with their associated ffxes} since they are representative of the 
whole set of hugs encountered during the experiment. This set is summarised 
in the taxonomy of "juggling bugs" given in figure T2, An important aspect 
of the taxonoigy has to do with notion of a good descriptive language. In 
this case and in the protocol in the appendix*the names in the taxonomy 
attempt to be both a name and a description of the physical event. This 
device has two fold purpose. It greatly simplifies the difficult task of 
real-time analysts of complicated movements. It also facilitates coinuni- 
cation about those movemonts. For more information about the important 
but difficult problem of developing descriptive languages for human nove¬ 
ins nt see Birdwhistle (5 ). 



Figure 12A 
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TOSSING 

NAME 

FORWARD 


BACK 


A TAXOMOMY OF JUGGLING BUGS 


BUGS 


EXAMPLE FIX 


a) FACE A WALL 
bj POPRING 
t) DROP CATCH 


VERY FORWARD TOSS 


POPPING (when it occurs 
on the first toss as is most 
common). Later occurrences 
are usually caused hy a gross 
error on proceeding cycles and 
hence disappear nhen the 
prior error is fixed 




SLIGHTLY BACK TOSS 

i 














Figure 12B 


WIDE 



NARROW 



VERTICAL 


“he next three bugs usually 
occur either as the result of 
a toad node? of what a toss 
should look Tike or as the 
consequence of an earlier 
mistake somewhere in the 
preceding cycles, Iti the 
first case the fi*. is a careful 
demonstration of a good toss 
along with verbal guidelines 
like "'hEad high" or "shoulder 
width►" 

In the Tatter case they usually 
disappear along with the 
prior mistake. (The VERTICAL 
bug has a separate name because 
ft is so disruptive when it 
Occurs that It deserves special 
attention J. 













Figure 12 c 
COLLISION 



a) Demonstrate the dfffErence 
between underthrowing and 
overthrowing, 

b) Pretend there's a large 
pipe beside and “inside" the 
trajectory of the in coining 
ball into which you must, 
throw the outgoing ball. 


CAN'T RELEASE 

This bug moat frequently 
occurs on the 4th toss and 
may perhaps be due to the 
pedagogical sequence used 
which einp has lies "getting to 
3" or to an overly cautious 
"dynamic lookahead" ability 
which predicts disaster on 
the upcoming toss. In any 
event the fix is to force the 
occurrence of the inhibited 
toss by either changing the 
toss cue via instructions 
like "don't throw until you 
hear me shout NOW" (this is 
a variant of DftOPCATCH) or 
by removing the fear of 
failure by instructions lik# 
'don't worry about catching it 
for now, just throw it," 




CATCHING BUGS 


Figure 1£0 


NAME 


example FIX 


FINGERNAIL 



TJie catching errors shown 
here almost always stem 
fr&m poorly executed 
previous toss or sequence* 
of tosses. Hence the 
fix in most cases involved 
correcting the offending 
TOSS. 


HAMDSLIP 

















CHE5TCATCH 


FigurelZE 



(Usually found only after 
serious BACK or timing bugs) 


SWIVELCATCH 


{severe hip rotation but no step} 


LUNGECATCH 

{involved one or irorc steps, lunges, etc, i.e,, a last ditch attempt) 








TIMING BUGS 


Figure 12 F 


NAME 


EXAMPLE FIX 


EARLY 



LATE 



Although ail of the bugs 
exhibited so far are* at 
some level s accurately 
described, as timing bugs, 
some are more directly 
concerned with the sequencing 
of major events, such es 
tosses s rather tfoar. details 
within a given event such 
as a release within, a given 
toss. Hence they deserve 
special attention and names. 
The fixes in all cases in¬ 
volve establishing a good 
major event sequence by 
games like BRQPCA7CH, coun¬ 
ting- out loud* demonstrations, 
etc. 














TIMING BUGS leant,) 


Figure 12G 


SLAP 



In the SLAP bug the outgoing 
TOSS is so late that there 
Is no time left to throw. 

In a desperate attempt to 
both throw and catch at the 
same instant the hand 
compromise e both tasks by 
"slapping" (while still 
holding onto) the supposed 
outgoing ball into the 
incoming ball, The fix 
for SLAPPING is to forbid 
the subject to do it (since 
it is a voluntary act). 

The ball must be either 
caught or allowed to drop 
untouched. This helps to 
focus attention on the proper 
EXCHANGE initiation point. 





The Out-1 i n es of .m comp j tat i on31 Theory of Juggl i n g 


Overview 

The proceeding sections of this piper were concerned vrith the 
presentation of empirical data about the skill of juggling approached from 
a computational point of view. From that point of view the experimental 
Observations with respect to the role of model In physical skills* the most 
connon and most severe bugs and associated fixes* as well as the notion of 
a complete taxonoriy of bugs all have to do with what computational experts 
would call software aspects of juggling. 0y definition however, the cwi^u- 
tational paradigm consists of a set of software instructions (by which the 
programmer fulfills his model of the problem, creates bugs, etc.} and a 
set of hardware devices by which those instructions are interpreted and 
executed. For people of course the hardware devices by which movement 

instructions are executed are muscles, neural networks, the motor cortex, 
and so on. 

It is not possible at present to give a complete theory of this hard¬ 
ware device for physical "cornrands" It is difficult enough to give detailed 
theories about very small components of what might be called the “physical 
computer part of the human body. The rest of this paper is concerned with 
establishing empirical constraints on the range of theories which might be 
offered for the various components of such a computer,- The issues considered 
have to do with timing constraints, potential control structures, naming 
and the construction of subroutines T 






Timing Analysis 


It should be clear, ecraputatfonally speaking, that juggling 1, a re „ 
time process and further, that the constraints imposed by the physics 
involved are fairly severe. The following discussion has as its goal a 
clear formulation of the timing constraints faced by an accomplished juggler 
as he performs his routine. The constraints derived here combined with 
what is known of human resoonse times should be of considerable value in 
designing a control structure for a theory of juggling movements. 

Human Constraints 

It is apparently true that any willed skeletal movement takes approxi¬ 
mately 200 ms. to initiate. That is to say, when your head tells any part 
Of your bony to move, including the eyes, on the order of 200 ms elapse 
before the movement actually begins. Although there is some variation 
depending on the task, the individual, and to some extent the amount of 
practice, the 200 ms elapse latency is essentially invariant, particularly 
for large movements of the kind involved in juggling. Likewise the maximum 
acceleration for the hand approxf irately 24Q0 in,/sec 2 . 

These parameters can he verified e*npi>fcially by the 
foi?owing two experiments] 

Try to catch a ruler dropped (by someone else} between 
your almost closed fingers„ The zero mark should he 
even hith the top of the hand. The hand should be 
resting on some fixed object so it can't "chase JI the 




ruler. The fingers will usually grasp the ruler sone- 

Wh6re t>etween the ? 8 inch marks which corresponds 

roughly to a 200 ms delay. This explains why it is 
nearly impossible to a catch a 6 “ dollar bill in the 
popular version of the experiment. • 

The second experiment involves trying to swat a ruler 
dropped past some flat surface like a table. The hand 
is positioned 3" from the edge of the table and moves, 
when the ruler is dropped>in a direction which is 
horizontal to the table. The ruler is held so that 
the end fs even with the top of the fable. Kith a 
little practice you can just nick the end of the 
ruler *s it goes by. Since the ruler falls 72 * in 
>a250 ms > the h «Tid moves 3 " in SO ms, assuming a. 

200 ms latency. This corresponds to an acceleration 
of 2^30 in./sec. „ These examples are due to Lacy (&). 

Ballistic Constraints 

Given that the hand operates with a 200 ns latency and can accelerate 
at no more then «» 1 how „„ these c0nstra , nt5 CMpirs ^ 

the ones imposed by the laws of physics? The first step Is to determine 
the velocity of the ban in normal catch!ng regions. FoP . p , r50 „ , ^ 

tall, a toss typically rises to a siasimur, height of 6 1/2 feet and is m)l> 
eeoght at slightly more than shoulder level. This situation can be modeled 
fmn, the tinring point of view as a ball dropped from a height of 6 1/2 feet 
and caught at a height of 5 1/2 feet. Thus the ball reaches a velocity of 
96 in./sec. and hence requires 250 ms to travel the 12 inches from the top 




of Its arc to the level at which ft usually caught. If for soma reason 
the distance traveled becomes as imjch as £4 inches the velocity of the 
ball increases to l3fi in,/sec. so that only 350 ms are required to cover 
the longer distance. 

Basic Cycle 


It should be noted that ths hand which is about to catch the incoming 
ball (i .e, in our model the dropped ball) is currently occupied with tossing 
the outgoing ball and hence at the conclusion of that toss is very close to 
where it should be in order to catch the incoming ball. In fact if atten¬ 
tion is focused on say the jugglers loft hand the following pattern of move- 
nents can be observed* 







f 

1 ft, hence 25(3 ms 

1 


Figure 13. The Basic 


Cycle 


For each hand the basic cycle consists of 



TQ$5 

SHIFT 

CATCH 

HOME 

REST 







lTld the shift part of that Cycle has to cover only 3 or 4 inches for most 
tosses* By the second ruler experiment it seems reasonable to believe the 
hand can caver such distances within the available 2$Q ms and hence that 
a kind of control structure one might call 5 ''reaction" theory could 
support Juggling movements Satisfactorily, Such a theory would claim, for 
example, that at the end of the TOSS movement the eyes perceived the position 
of the incoming ball and "reacted" by issuing a command to move the hand 
under the ball. Likewise the actual contact of the hand and the ball causes 
another reaction in the form of a GRASP movement. The central tenent of 
a reaction theory of movement control Is that the conmands which initiate 

movements are Issued in response to rather than in anticipation of external 
events. 

An Anticipation Theory 

Unfortunately the proceeding analysis does not include latency times 
for the various movements and as yet says nothing about the control of eye 
movements, These considerations make it obvious that a more complicated 
anticipation" theory will be required for arty control structure the overall 
theory might select. For example .figure is presents a frame by frame analysis 
of a brief {a toss} juggling sequence. This analysis shows that the most 
crucial part of the EXCHANGE, the SHIFT movement, lasts on the 





Ff^iirg 14 
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Basic Cycle 
Timing 


P 


/ 


(Ball travels 1 ft in 250 ns} 


(330ms) SHIFT_ - 

contact "V* 16356 J. 



\\ / 

RASP \ / TOi 


tGRASP \ / TOSS (36Qms) 

(165msA / 

\ / SHIFT movement initiated here early 

V / in the TOSS [rovement 

F30ME 1 V 
(1023ms] iRESt (360ms) 


average 330 ms after ft Wns ■ Of course there is a theoretical question 
as to whether or not the 330 ms consists of a ?Q0 ms waft and a 130 m move 
or consists entirely of a 330 ns move. The empirical evidence from the video 
tape is clear bn that point however. There Is no observable pause at the 
end of the TOSS movement and certainly none of 200 ms duration. Rather 
the whole TOSS, RELEASE^ SHIFT, CONTACT, HOME sequence appears to be bne 
smooth nsoyereint. 



Left HA:m 


RIGHT H4JJ7I 

Dcumawecp {9) 


(II] tJpHW#*p 
Hel&aas —- 
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Fig, 15. Till ing Analysis of Basis Cascade 
Juggling C.ycfe (For an accomplished Juggler) 
Times are given in terms of video frames and 
are indicated in parentheses for convenience 
One frame * 1/30 sec » 33ms, $g for example 
the 1st UPSWEEP by the right hand tools 
II frames * t + e. 363 ms. 





























































The only way this could hate occurred from a control point of view is for the 
SHIFT movement to have been Initiated some 160 ms into the TOSS movement; the 
GRASP movement to have initiated 130 ns into the SHIFT movement* etc, (se* 
figure :i&h 

To return the theoretical discussion* the issue becomes forced when' 
■eye movements are considered. At least one eye fixation i 5 required to deter¬ 
mine the trajectory of the ball fr flight- Yet eye movements also have a 
200 ms latency. So seeing the ball and causing the arm to catch it involves 
at least a 400 ms delay assuming an instantaneous trajectory calculation 
and zero time for the arm movement. But the model allows only 250 ms for 
the ball to fall the 12 inches involved in a normal catch, Doubling this 
distance adds only 100 ms or so to the time available. Thus it is clear 
tha^ the SHIFT movement is anticipatory In nature in the sense that it 
must have been ."planned," i.e., initiated, during a prior movement, notice 
that the preceding discussion does not consider the possibility of quick- 
reaction low-Tevel feedback loops which obviously coold affect the details 
of the analysis, Nevertheless the primary conclusion still stands. Any 
theory of Juggling movements must contain a control structure which is 
capable of supporting parallel, real-time, events of an "anticipatory re¬ 
sponse" nature. 
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&ugs Coma In Eunches^ 

THe next experimental observation also h« to do with tilling information 
bwt in a different sense. The observation is that hugs apparently cone in 
benches, at least that is tree for the Ogling variety ^way, ItJ 
safe to say that above the DOUBLE TOSS level most of the subjects were initially 
grappling with two or more simultaneous begs.' One fluent combination was 
EAELi. LATE/FORWARD. The protocol in Appendix I contains many other examples. 

This observation is significant for both theoretical and pedagogical 
reasons. One of the most important differences between mental and physical 
events is the fact that all physical events reduce ultimately to Some pattern 
of muscle start and stop times. Although It could likewise be said that 
all mental events reduce ultimately to something like current flow.in some 
deep sense it seems to be true that physical events are considerable more . ' 

time-dependent than mental events. We have seen for example the whole 
taxonomy of bugs which can be generated from subtle shifts in the timing 
of events in the basic juggling cycle. It is perhaps reasonable to conjec¬ 
ture then that simultaneous bugs are due to a combination of timing mis-speci- 
fications in the learning process and the narrow range of permissible 
specifications afforded by physical constraints. The Inucrtant theoretical 
implication is that any theory of movement must have a mechanism, perhaps 

a whole language, which is capable of describing and modifying timing events 
at the millisecond level!. 

Pedagogically the observation is important because if, as conjectured. 





Juggling is a reasonable representative of physical ski 17s in general, then 
the indicated experimental direction is the creation of learning environ¬ 
ments in which the same bugs occur, but one at_a time . For juggling, this 
might take the form of a machine which allows EXCHANGE practice in slow 
motion, or as a separate entity, EXCHANGE bugs could then be dealt with 
one at a time independently of' the rest of the process. 

The Breakthrough Phenomenon 

The single nest surprising discovery made during the experiment was 
that for most individuals progress, as measured by either the number of the 
ql.ilI i tjx of successful tosses, was. not at a'1 continuous but .rather +appeared 
to consist of a series of breakthroughs or plateaus. These breakthroughs were 
not initially stable, frequently being attainable for only one or 
two trials, but became more frequent and stable over time. The really 
astonishing piece of information is that the magnitude (measured in tosses) 
of the breakthrough was usually 2 - 4 times that of the previous level! 

Jumps fron 3- tosses to It) or 11 tosses were cDemon* Se^ for example the 
sixth minute of SI or the eleventh minute of 52 in figure 17. Almost, every 
subject In the experiment exhibited a breakthrough which virtually doubled 
the previous best effort. 

One explanation of this observation fs that several bugs vanished or 
were temporarily overcome simultaneously thereby allowing a dramatic break¬ 
through to occur.' The fact that the breakthrough is not initially stable 
but improves with time suggests that 5 mho form of trial and error or hill- 








clinging search is going on at the lower levels of tiding specification. 
This argues against a strictly symbolic naminq/addressing mechanism in th 
overall theory. 
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Fig* 17C. The Breakthrough Phenomenon (35) 












It's Hard To Give VoursolF Advice 


Here ‘* an observation which is true only sometimes and Is intriguing 
both when it does and when it doesn't apply. The question is why is it 

- rd tQ Q 1 v ? y otjr se!f g ° yi _5 £ when learning new physical skills. The most 
extreme sample of this situation fs the disastrous .’'blind trials- approach 
wherein the suoject feverishly tries the task over and over without even 
taking the trouble to describe his mistakes, Tet alone advise himself on 
how to fix then. 

In many cases though, thoughtful analysis has 
produced! a reasonably accurate description of the 
mistake but It's still difficult to translate that 
information into corrective action, for example, 
most people can sucessfully tell themselves to 
’'toss higher 1 " (to gain more time) but apparently 
ft's quite difficult for many people to tell 
themselves "toss later" or ir to$s right before 


Ifs also interesting to note that frequently the best advice you can 
give yourself appears on the surface to have nothing to do with the task 
at hand but in reality corrects exactly that portion of the movement which 
was previously erroneously specified. For example in tennis the advice 
Serve as though you were trying to throw your racquet away but hold on " 
frequently helps the novice master the service movement more quickly. In 
juggling the advice i’ractice while facing a wall" is frequently useful for 
correcting the FORWARD and other bugs. 








T.'ne theoretical implications of this observation have to do with the 
mechanisms by which existing movement specifications can be brought to hear 
on the task of learning new movements. The fact that existing knowledge is 
relevant to similar task should he obvious and has beer demonstrated experi¬ 
mentally by tasks like learning to write with the non-preferred hand. The 
apparent ability to advise yourself on certain tasks but not an others 
raises questions about the mechanism by which a tty ice is accomplished and 
the degree to which it is a symbolic process. Thus the overall theory of 
physical movement must explain why the symbolic advice “throw this way" 

(in the serve example) is useful and can be acted upon, but the equally 
symbolic advice "toss earlier" (in juggling) is only marginal ly useful. 


The Construction of Suhroytfnes 


A constant there which runs throughout the experimental data has to 
do with the question of hew "chunks 1 ' of movements are grouped into larger 
chunks. Computationally this Is the Issue of sub^procedurization or 
subroutine construction. It appears to be pertiaps the most central issue 
in designing a theory of physical movement as welt as one of the most 
difficult. 

Part of the difficulty lies in ascertaining the real primitives 
of movement specification and the degree to which the process is 
symbolic. At least some of the problems posed by this gao in cur knowledge 
can be avoided if we assure that for advanced skills (like juggling) the 
relevant aspects of the component movements are predominantly symbolic and 
hence can be treated like ordinary subroutines. Of course this assumption+ 
which may be entirely unwarranted, namely postpones the issue of what 
happens inside a given subroutine. However it allows us to beoin the task 
of describing the overall learning process from a symbolic point of view. 

For example + 1n juggling t the oasic learning process apparently centers 
around combining the first part of an existing TOSS subroutine 


TOSS 

DOWNSWEEP 

UPSWEEP 

FLIP 

FQLL0WTH ROUGH 



wi th the beefy of an existing CATCH subroutine 

CATCH 

TRACK. 

move-unher 

flee 

GRASP 

and inserting MOVE’S as appropriate to produce the EXCHANCE procedure 

EXCHANGE 

JOSS* 

MOVE 

CATCH 

MOVE 

where TOSS* fs TOSS minus the FOLLOW-THROUGH line 

Notfce that the ffnat version EXCHANGE cannot be a simple linear 
conation of TOSS, MOVE and CATCH * As previously discussed, the latency 
times and the real world constraints rule this out. It is certainly true 
however that, as In Sussman's thesis (see reference 7] the linear approxl- 
(nation subroutine is a good initial model from which to start* i.e* there is a 
good chance that the debugging process will converge to the desired final 
structure. The linear model idea also brings to mind the discussion of 
cascade guggling models in section 4, Sussmen and Goldstein (8 J also 
, r °vide clues as to how that convergence process might go In different 
problem domains. The degree to which those methods apply to the domain 



of movement depends a great deal on the extent to which movant primitive 
are symbolic. Issues such as annotation, invocation and patching however, 
appear to be good starting points for the discussion of whether or not the 
Goldstefn/Sussman theories can be applied to physical procedures. In any 
event if aopears to be true at least at the more advanced levels, that 

physical movements can successfully be treated as subroutines from a 
computational point Of view* 


Surmary and Cane lusipn 


In surinary* we have seen in'considerable detail the extent to which 
the computational paradigm can be applied to the skill of juggling* a skill 
riJiieh is hopefully representative of most forms of higher-level skill. The 
discussion initially focused on the external or performance aspects of 
juggling acquisition, A descriptive language for juggling movements, 
formulated in bug/fix terminology was developed to the point of exhibiting 
an extensive taxonomy of cascade juggling hugs. 

The latter part of the paper was concerned with establishing the gross 
outlines of a theory of the internal mechanisms by which movement commands 
are interpreted and executed. Empirical evidence which was found useful 
in this regard included an observation about the importance of having a 
model of the physical task at hand, a study of human ballistic constraints, 
the unfortunate fact that hugs come in bunches, the very surprising break¬ 
through phenomena and the Intriguingly difficult task of advising yourself 
during physical skill acquisition. 

This evidence Shows that while physical skills have an obvious symbolic 
component* the precise extent to whtch the overall theory should be symbo¬ 
lically oriented is not clear, Evidence which supports the symbol 1c point 
of view includes the data on models and the successful instances of advice. 
Evidence which argues against a completely symbolic theory includes 
the unsuccessful advice cases as well as the "trial -and-errw-l fke" 
parameter search which is assumed to underlie the breakthrough phenomenon. 



The issue of control structure is somewhat more clear-cut. human and 
physical constraints make ft obvious that a theory of movement must include 
a control regime which is capable of supporting real-time, parallel events 
of an anticipatory nature. There must also be a irechanism far describing 
and modifying event times at the millisecond level. The present experiment 
yields little Information about feedback mechanisms. 

The theoretical outline concludes with the observation that the central 
issue aopears to revolve around the problem of bow existing movement patterns 
(subroutines) are combined to fonn new movements. This statement Is confirmed 
by a subroutine analysis of the Juggling learning task. The procedural 
modification theories of Sussman and Goldstein appear to be partially 
relevant to physical skill acquisition frcm that point of view. Hence the 
issues of invocation, annotation, and self-debugging appear to be good 
topics for further research. The non-symbolic nature of movement primitives 
appears to he a central issue in such endeavors. Respite the existence of 
these problems however, It Is felt that the primary conclusions as to the 
similarities of physical and mental activity and the relevance of the 
computational paradigm are thoroughly Justified, 


APPENDIX 


Protocol for SI* 


1) E-Show me your model of juggling. Make the tags move as though you were 
juggling. 

2) SI-Well let's see. You throw this one (f.e, the left One) in the air. 

Mheo it reaches its high point you then begin (the transfer operation?) 

■3) E-Oust make them move through the motions, 

4} ST-This one goes up (i.e, the left one) and this one goes over (1,e r the 
right one)„ 

Tosses L-+R, passes R-*L. 

5) E-Vou have the nwsel of juggling that most people have, namely this 
[demonstrates shower" juggling). You can juggle that way hut it's 
much hander,. I'm going to teach you a new kind of juggling. Let's 
get some terms. This Is a toss (demonstrates a toss). This is a pass 
'.cemonst rates a mass). There's no passing in the juggllnq I’m about 
to do. It s all tosses (demonstrates cascade juggling). 

6) Sl-Un huh. 

7) E-I'd like for you to do this. One in each hand TOSS ft L„ TOSS L R. 

Now notice I don't want simultaneous tosses (demonstrates) and I don't 

almost simultaneous (demonstrates). I want a distinct cadence 
toss, toss. 

8) unintelligible 

9) Sl-L^R, 

R-*U pass, dropped, 

ID) E-You ipsaaifd 

11) SI-Yeah. 

12) L“* R "handslip" 

R-*L wide, forward. 

13) I-* ft fingernal t 

R-* L wide* forward. 

H) E-Toss the second ore more like that (demonstration) 

51-I'm used to tossing with this hand (left) but not this one (i,e. right). 
E-Toss it in a nice parabolic arc. 

*In this protocol 51 is the subject, E is the experimenter, L“*ft is a toss from 
the left hand to the right hand Xmeans a satisfactory toss and terms like “hand- 
sltp j 'wide," "forward" the names of specific hugs from the taxonomy, pgs,17-22. 






15} R“*L ^ (s means satisfactory TOSS), 
15} R-H. ^ 


?7] E-Right, flow do the exchange, 

IB) R+L slightly forward * hands lip 

L-»R back, "pipch catch 11 (f.@ + thumb and ffrst two fingers). 

19) L+fiv- 

R^L slightly wide, slightly forward. 


2U) E-OX quit. That took exactly 2 1/2 minutes. 

rfn^t Sf e h ?! d fi he thlrcf ba ^bag in your hand, 
don t toss it (demonstration) ■ 


how dp the same thing 
Just hold it there. 


21 ) 

R-*L low. 


22 ) L-*R ^ 

R^L ^ 


£-0.K,» 

23} L R back, dropped, 

R L very forward, 

E-OX. 

24) L^R ^ 

R-* L forward 

SI-' have trouble tossing with this (right) hand, 

25) 1-* Ft 
R-r L ^ 


E-PTease talk out loud. 


2b). 1_->R ^ 

R-tl fingernail 


51-1 can really toss well 
too coordinated?). 


with my left hand but my right hand (isn't 


27) E-Looks good to me. 


Now what I'd like you to do is when you'rd at the 



stage when the second one's coming down, toss the third one (demonstrates) 
It goes like this (slow demonstration), f 


£8) L^R slightly forward 

f?^L very forward, dropped 

L^R wide and forward, caught by stepping forward. 


E-Almost, 


29) L-> R ^ 

R^L very forward, very wide, stepped forward, dropped 
L“^ R caught directly ovgr shoulder due to previous step t 


E-Coraent to cameraman, 

30} L-*R ^ 

R^L vertical 

L-»R very forward, lungecatch 

E-Your second toss went straight up and straight down. 
SI-Yeah 


31} L-*R 

R~*L slightly hack, dropped 
L^R slightly forward 


E-Ah you had it but you dropped the second one. 


SI-It's hard for me (to concentrate on catching?}. 

32} L-^R ^ 

R-*L slightly baek k dropped 
very forward* lun-gecatch 

E-tou're gettings very nice cadence there, Rmnber that-cadence. 
33} ItpR ^ 

R^-L slightly back, chestcatch 
L"*R fingernail 


34 } 


E-O.K., quit. That took you a total of 3 minutes* 35 seconds. 

Normally we have peope stop here because there's about 3 important 
ooinr.!= in juggling; 3, 10 and 100, But you got there so quickly we'd 
like to have you go on, let's see hew quickly you get to 10. 



J^™; S S «?p”g te6P SOinjl the aD “ rui " «■"> tta imt toss 

£"*?« hel[J5 *° thl ™ n rea "J' h ’S h s° yo« have time to think 
£-R1ght, keep talking out loud. 

35} L~*L higli s verticals caught with left hand (unintelligible) 

36) L^R very high, back [unintelligible) 

37) L-*R high back 

R^?L forward, fingernail 

51 -If s like throwing tennis serves, 

3S) L-*R high, slightly back, dropped 
R^L 


35) L->R ^ 

R^L late, caught with R hand, 
40} Lr» R vertical, chestcatch. 


41) E-Notice that (t comes and goes. All learning goes like that Everv 
thin, dees wrong then it cones back for a coijll of times, tL 


51-1 know how that is. 


45) 


L->R 
B^L 
L-* R 
R *L 


fl nge mailed 
1 a te 

back, wide* dropped 
very late, just rolled 
toss fslapdrop?}, 


out of his hand while catching the third 


E-O.K.* you almost got rid of the fourth toss* 

43) L^R back* hands lip 
R^L late* very forward 

44) 1) R 

Z) very forward, lungecatch 
3} L^R Tate 

4) late, back, leanback catch 
t) L “>R very forward* lungecatch 
b ! R^L very forward, lungecatch 
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7} Ir^R (not visible) 

8J R^>L {partly visible) slightly back 

9) L^*R (not visible} 

10) R + L (partly visible) lungecatch bounced loose, cbestcatch 

11) L-^R very back* stepback-catch, 

45} E-That took a total of 6 minutes 15 seconds, O.K., let's see what fine 
timing looks like. Comments on juggling as an unstable {in the 
nathernatical sense) process {advice about "laying" a toss up beside the 
incoming one and a demonstration), 

46) L -f»R ^ 

R^L late 4 vertical, caught with R 
(unintelligible) 

47} L^R 

R-*L late, vertical, caught with :R 
A little more flip, you don't want to wait so long. 

48) L^R 

R-*L forward, lungecatch 

E-fou have too much followthrough in your left hand there. 

4R) L-*R slightly back, fingernail 
R^L forward, lungecatch 

E-Right, much more like that. 

50} L*R^ 

R-^L forward, lungecatch 
51} L^R ^ 

R^ L fate, forward, lungecatch, 

52) E-Advice ref. "popping"theory, demonstration. 

53) 51-Practices popping (sin times) 

E-O.K. Hit it. You've al ready done 11, 

54) 

FH>L forward, lungecatch 
{unintelligible) 

55) L-*R ^ 

R-^L slightly wide. 


( 


56) L > R ^ 

wide, 

57) L’-Rv^ 

R^L slightly forward, slightly wide 
(unfntelligible), 

58) L*R~^ 

R-*LV' 

{unintelligible) 

59) L-*R 
R-*L 

£-CLK., Go ahead. You've done 12 already- 

60) L^R vertical, taught with L. 

61) L-*fl vertical caught with L 
Sl-O.K*. 

62) L*R low, hardslifj 

R^L later vertical caught with R, 

SI-unintelligible* 

63) L-^R late 
R^L late 

slapthrcw, both dropped 

E- Don't slap it. Toss it higher. 

64 ) R X 

R^L back, hands!ip 

i**R vertical, caught with l 

SI-[Getting in trouble because Fm not getting then out far enough??) 

65) L>R fingernail 
R-*L ^ 

L+R very low, very forward, Tungecatch 


E- You keep getting Tower 


66] 1) 

2) R-*L late, forward 

3) L-*R forward* lungecatch 

4) R-n hack 

5> almost vertical* slightly low 
6} R*L late 
7} L>R 

a} ft^L Ute, diesteatch* dropped 
9) L-* R two handed catch 

SI-0 h K, a I *m not getting the tosses (unintelligible}, 

it^youSseTf 9ettir,g g£>&cL dofng that and you*11 

$7} 1) L-Kv/ 

2) R-»L forward, lungecatch 
J) L^R slightly vertical* hands lip 
4} R^L late* two handed catch 

E-Host people don't use the height enough to cheat and get more time 
up there. 

66) t) L^R fingernail 

2) R*L forward* lungecatch 

3) L-* R forward* lungecatch 

4) R->L very wide* leartcatch 

5) L-* R not Visible 

6) ft-*L not visible 

7) L> R not Visible 
(unintelligible). 

69) L R vertical. 

70] 1) 

2) R*L slightly forward and left 

3) L^R 

4) R-*L wide* rotates left to catch, ft 

6) L“>R vertical* rotates even further left 
G) R^L not visible 

7) L^R cot visible* apparently slightly vertical 

5) R->L forward 

9] L-^R vertical* forward, lungecatch, dropped 
10] L forward* lungecatch 

E'looks good to ire. 

SI-Still moving around too much. 


71} 1) 

2 ] R-^l forward 

31 L-*K forward, leancatch 
4} R^l forward, lurgeta tch 
5,1 R forward, la an catch 

6) R^L forward, handslip 

7) l^R forward, lunge catch 

8) very bade, dropped. 

72 ) E-Q.Kr, .you do in fact have sortie indication of a migration hug. The 
way you fix a migration bug is face a wall {demonstration, more advice 
ref, migration bug) 

73} (now against wall} 

L^R wide, back 

74) 

R"?L passes! 

75) L->K wide, fingernail 
R^ L back, handslip 

R late, low,, bits the wall 
{unintelligible} 

76) 1} L^R fingernail 
2} R->Lv" 

3] l* R ffngemail 

4] R>L wide* leancatch, fingernail 

5] L^R forward 

6] R-*L forward, leancatch 

7} L-> R back, chestcatch, dropped 
8] R">L wide, fingernail 
9} L^R slightly vertical 

E-The one that got you was the one that came hack. 

SI-Yep. 

77) L~>R forward 
R^L wide 

78) L^R vertical, caught with L 

E-They tend to go straight up and down. 


79} l -^R hands I fp 

R-? L vertical, caught with R. 


80 ) L-*R^ 

vertical, fingernail, chestcatch, leanbapk 
L"*R forward, hands Tip 
R^L leancatch 
(unintelligible} 

Bl) L-^R fingernail 

L^R forward 
R-^t handslfp 

L-^R vertical, forward, almost hit the wall 
R*L wide, forward, leancatch. 

32} 

R^L ^ 

L^R forward, vertical 

ft-^L slightly wide, hands 1 ip 

L^>R early forward, caught against wall 

R-VL handslip, 

83} E-O.K., quit wasting film on him. That tool: a total of H minutes 
SI-I was just getting the hang of it* 
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